Search for: All records

Abstract As generative artificial intelligence (GenAI) tools such as ChatGPT become more capable and accessible, their use in educational settings is likely to grow. However, the academic community lacks a comprehensive understanding of the perceptions and attitudes of students and instructors toward these new tools. In the Fall 2023 semester, we surveyed 982 students and 76 faculty at a large public university in the United States, focusing on topics such as perceived ease of use, ethical concerns, the impact of GenAI on learning, and differences in responses by role, gender, and discipline. We found that students and faculty did not differ significantly in their attitudes toward GenAI in higher education, except regarding ease of use, hedonic motivation, habit, and interest in exploring new technologies. Students and instructors also used GenAI for coursework or teaching at similar rates, although regular use of these tools was still low across both groups. Among students, we found significant differences in attitudes between males in STEM majors and females in non-STEM majors. These findings underscore the importance of considering demographic and disciplinary diversity when developing policies and practices for integrating GenAI in educational contexts, as GenAI may influence learning outcomes differently across various groups of students. This study contributes to the broader understanding of how GenAI can be leveraged in higher education while highlighting potential areas of inequality that need to be addressed as these tools become more widely used. 

Systems thinking is a skill that enables students to grapple with complex problems, often to which there is no clear problem definition or solution, there are many stakeholders, and there are many systems involved (e.g. sociotechnical or socioecological systems). Fostering the development of systems thinking skills is crucial as the problems students encounter in their lives, and in formal and informal educational settings, are increasingly complex. Ongoing research points to the need for more domain-general tools to assess systems thinking in a variety of K-12 settings. Many existing tools or methods used to assess systems thinking in K-12 are often domain specific (e.g. the water cycle in environmental science) and do not always transfer well to more complex problems across content areas. Furthermore, grounding the development of systems thinking skills in the locally relevant contexts that inform and affect students' day-to-day lives also offers the opportunity for students to engage in problems they find interesting and in which they may connect more deeply. This work-in-progress paper presents the development of a general tool informed by existing research in systems thinking and pedagogical practices in K-12 settings. The initial tool development is based on an existing published tool that has been used in undergraduate settings that challenges students to consider an ill-structured problem based on a real world scenario, in which a rubric was defined and applied to measure different systems thinking competencies. The existing tool measures students' ability to identify various contextual and technical aspects of a problem, to identify various stakeholders and stakeholder needs, and to identify short-term goals, long-term goals, and unintended consequences of potential solutions. Knowledge and experience from the development of this tool will be used to pilot an assessment with K-12 students to measure their systems thinking skills in problems that are relevant to them and their experiences. 

Broadening participation in the skilled technical workforce is a national priority given strong evidence of growing critical vacancies in engineering coupled with the urgent need for this workforce to better reflect the rich diversity of the nation. Scholars and activists often call for increased focus on education access, quality, and workforce development among rural Appalachian communities, noting that students from these communities are under-represented in higher education generally, and engineering careers specifically. Investing in preK-12 education, engaging youth as valued members of their communities, and cultivating workforce opportunities such as in advanced manufacturing have all been highlighted by the Appalachian Regional Commission as vital to strengthening economic resilience. However, scaffolding engineering and technical career pathways for Appalachian youth at scale in the context of broader systemic issues is challenging. Past research on the career choices of Appalachian youth show that sparked interest alone was not sufficient to consider engineering careers. Research on the sustained development of interest in engineering highlights rich networks of formal and informal experiences as catalysts or supportive infrastructure. Yet, access to such opportunities varies greatly. School systems often lack the necessary personnel, money, or space to offer these experiences, and, even if opportunities are available, often only a small subset of students may be able to participate. Further, common views of what engineering work is and who can do it are narrow, biased, and exclusive. This CAREER project has focused on three areas of research. The first area, focused on school-industry partnerships through COVID-19 in the region, highlighted the importance of rich partnerships, resilient stakeholders, and innovative contexts to persist throughout the COVID-19 pandemic. This is particularly pertinent to partnerships and collaboration, sustainability of these collaborations, and programming in the context of STEM skilled technical workforce development programs in rural places. The second area of research, focused on developing a conceptual framework for engineering education research and engagement in rural places, highlighted the importance of place, individual student and community assets, and leveraging these things to provide context and meaning in a decontextualized K-12 curriculum. Finally, the third research area, focused on systematically reviewing literature related to the assessment of systems thinking in K-12 education, highlighted the lack of comprehensive assessment tools that can apply across many educational disciplines but particularly in areas as it relates to socio-technical problems. Together, these three research areas ultimately seek to inform broader aspects of K-12 education, such as career and technical education, issues related to rural education, and ultimately focusing on students’ ability to handle complex problems in their communities or other contexts with systems thinking. 

Abstract Self-report assessments are used frequently in higher education to assess a variety of constructs, including attitudes, opinions, knowledge, and competence. Systems thinking is an example of one competence often measured using self-report assessments where individuals answer several questions about their perceptions of their own skills, habits, or daily decisions. In this study, we define systems thinking as the ability to see the world as a complex interconnected system where different parts can influence each other, and the interrelationships determine system outcomes. An alternative, less-common, assessment approach is to measure skills directly by providing a scenario about an unstructured problem and evaluating respondents’ judgment or analysis of the scenario (scenario-based assessment). This study explored the relationships between engineering students’ performance on self-report assessments and scenario-based assessments of systems thinking, finding that there were no significant relationships between the two assessment techniques. These results suggest that there may be limitations to using self-report assessments as a method to assess systems thinking and other competencies in educational research and evaluation, which could be addressed by incorporating alternative formats for assessing competence. Future work should explore these findings further and support the development of alternative assessment approaches.